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© Graphics display tool. 



© A graphics display tool is disclosed to simplify 
the display of a plurality of graphical objects on a 
display screen (7). The tool allows a user to select 
from an inventory of fragments (18; 20, 21, 22, 24, 
26, 28, 29, 30, 32, 34; 60, 62, 64, 66, 70,72) those 
fragments required to build a figure (36; 54, 56, 58). 
These figures can have child and grandchild ele- 
ments associated with them. Each figure (36; 54, 56, 
58) also has a symbol (50) associated with it. On the 



display device (130), an overview window (100) is 
produced on which the graphic objects are shown in 
symbol form. A detail window (120) shows the 
graphic objects in more detail using either their 
fragment form or their symbol form. Child and 
grandchild figures can be directly observed in the 
detail window (120) by zooming into the selected 
figure. 
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Field of the Invention 

The invention relates to a graphics display tool 
with a graphics processor for creating images, im- 
age memory for storing the images and display 
means for displaying the images. 

Prior Art 

An article in the IBM Technical Disclosure Bul- 
letin, vol 27, no 10A. March 1985, pp 5496, entitled 
"Display named objects within a document" teach- 
es a real-time multiple data editor which provides 
for the integration of all data on a single page in a 
dynamic editable form. The page may contain both 
text and non-text object sets such as images, 
graphics, tables, annotations and handwriting. The 
user may manipulate these object sets on a page. 
Each object set is assigned a user-specified name 
and can be recalled at anytime. 

The Multiple Icon Viewing Design Tool 
(Ml DVT) is described in an article of the same 
name in the IBM Technical Disclosure Bulletin, vol 
33, no 10B, March 1991, pp 477-478. It is designed 
to work with the Microsoft Icon Editor and allows 
users to i) select and simultaneously display a 
number of icons on a single screen, ii) arrange and 
move the icon images anywhere within the screen, 
iii) present the icons with or without their title, iv) 
change, modify or eliminate their title, v) adjust the 
background colour of the window on which the icon 
is displayed and vi) expand the size of the icon. 

In the article "Homogeneous Presentation 
Graphics and Bit Image Integration" in the IBM 
Technical Disclosure Bulletin, vol 31, no. 10, March 
1989, pp 345-346, a system for integrating graph- 
ics objects and bit images is disclosed. This is 
achieved by defining an empty or null segment in 
order to reserve a position for the bit image. 

European Patent Application EP-A-0 243 228 
(PUBLIGRAFA) discloses a system for the creation 
of images for publicity documents. The system 
incorporates a video image reader and a graphic 
console with keyboard, graphic tablet and a moni- 
tor to receive, combine and modify image signals 
and colours. A computer is used to combine the 
video and vectorial image signals and creates one 
picture or a series of pictures simulating a product 
wrapper. 

European Patent Application EP-A-0 352 012 
(IBM) discloses a system for displaying graphics 
images on a display device. The system comprises 
a memory for storing graphics images represented 
by a plurality of picture elements. The memory is 
divided into a plurality of memory buffers and the 
graphics images can be either stored in a plurality 
of memory buffers or in successive positions in 
one of the memory buffers. Image mixing means 



combine the required picture elements for display. 

Similarly US Patent US-A-4 392 130 (ASEA) 
teaches a method for presenting graphical informa- 
tion in the form of an image in which the image is 
s assembled from a plurality of symbols defined in 
advance. 

An automatic icon generation system is de- 
scribed in the European Patent Application EP-A-0 
427 264 (FUJITSU). The system comprises an icon 

ro pattern memory for memorising, as icon patterns, a 
plurality of graphic elements, an icon synthesizer 
for generating the icon from the icon patterns, an 
icon utilisation controller and a display controller for 
displaying the icons. 

75 A number of commercial products are on the 

market which allow a user to create his or her own 
graphical displays on a display device such as a 
VDU terminal. Two of the best known are incor- 
porated into the IBM Presentation Manager and the 

20 Microsoft Windows. Microsoft Windows provides a 
Paintbrush facility which enables the user either to 
produce a graphical display freehand or to com- 
bine pre-defined graphical elements, such as a 
square, circle, rectangle etc. in order to produce a 

25 new image. The image can be coloured, enlarged 
or altered using the provided tools. The image can 
be saved for later use. Full details of the operation 
of the Paintbrush window are given in Chapter 8, 
pp 257-313 of the Microsoft Windows User's guide 

30 for the Windows Graphical Environment, Version 
3.0, published by Microsoft Corporation, 1990. 

General reference to object-oriented program- 
ming techniques can be found in Bertrand Meyer, 
"Object-oriented software construction", Prentice- 

35 Hall, London, 1988. 

Summary of the Invention 

All of the above cited prior art has the dis- 
40 advantage that for every new application that a 
developer writes, the graphic display has to be 
developed from first principles. That is to say, the 
applications developer has to develop new display 
techniques out of very simple graphic fragments. 
45 The display techniques form part of the applica- 
tions program and are permanently stored with it. 

In addition, displaying complicated graphical 
objects and allowing users to directly manipulate 
the interface requires substantial extra program- 
so ming, especially if the graphic objects may be 
networked together. 

As graphic displays become more complicated, 
it is necessary to display more and more items on 
the screen. This can lead to performance problems 
55 when drawing the screens and also results in a tack 
of clarity of the display. 

The object of the invention is therefore to pro- 
vide an improved graphics display tool which over- 
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comes the above problems. 

The invention achieves this by allowing the 
user to define a graphical object containing details 
of the appearance of a graphical figure. The user 
can then define instances of the graphical object 
which can be directly manipulated within the ap- 
plication that is being written. 

In order to improve the performance of the 
graphic display, with each instance of the graphical 
object a simple symbol can be associated. This 
symbol can be displayed instead of the graphical 
figure. 

The instances of the graphical objects can be 
linked together. These links may be defined be- 
tween instances of graphical objects in different 
hierarchical level - to obtain a tree-type structure - 
or between graphical objects in the same hierarchi- 
cal level. On the display device, the links may be 
made to be visible, such as by connecting a line 
between two linked objects, or they only be notice- 
able when the user carries out some action, such 
as zooming. 



Detailed Description 
Definitions 

s In order to enable a better understanding of the 

invention, a number of definitions will now be giv- 
en. Some of these definitions are extracted from 
the brochure "Operating System/2 Version 1.2. 
Programming Overview.", first edition, September 

10 1989, published by IBM Corporation. This docu- 
ment is incorporated by reference. 

Graphics Presentation Spaces 



75 The graphics presentation space is an area in 

which graphics pictures are created before being 
sent to a display device. The graphics presentation 
space also contains other information about the 
graphic data it holds. An application must first 

20 define one or more graphics presentation spaces. 
Each presentation space is identified with a unique 
handle. 



Brief description of the Figures 

Fig. 1 shows the equipment required for 
implementing this invention. 

Fig. 2 shows graphical layer concept ac- 
cording to this invention. 

Fig. 3 shows an example of a figure built 
up from fragments and its associated 
symbol. 

Fig. 4A shows the data structure for a tem- 
plate of a graphical object. 

Fig. 4B shows the data structure for an in- 
stance of the graphical object. 

Fig. 5 shows the data structure for an area. 

Fig. 6A shows the data structure for a tem- 
plate of a connection style. 

Fig. 6B shows the data structure for an in- 
stance of the connection style. 

Fig. 7 shows a mark on a figure. 

Fig. 8 shows the data structure of a mark 
style. 

Fig. 9 shows the data structure of a view. 

Fig. 10 shows graphic objects displayed in 
an area with the fragments from 
which the figures representing the 
graphic objects are built. 

Fig. 1 1 shows an overview window in sym- 
bol display and a detail window in 
fragment display. 
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Device Contexts 

Each display device to which the drawing is to 
be sent has unique characteristics. Those char- 
acteristics are defined in a device context. Each 
window can have a device context associated with 
it. Each device context is identified by a device 
context handle. 

Metafiles 

A metafile defines the contents of a picture so 
that it can be used by other applications. Pictures 
created by an application normally are discarded 
after the application is run and recreated the next 
time the application is run. The metafile contains all 
the instructions required to create the final version 
of the picture. 

Bitmap 

A representation in memory of the data dis- 
played on an all-points-addressable (APA) display 
device, such a a VDU screen. Bit maps define the 
contents of a complete physical or logical device. A 
window, for example, is a logical screen. Because 
bitmaps require no picture generation before dis- 
playing their contents on the screen, their greatest 
advantage is speed. 



55 



Icon 

A pictorial representation of a selection choice. 
The icon is defined in a bit map. 
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Tag 

A tag is a line of text. It is most often used for 
appending text to a picture. They can be sur- 
rounded by a box if required. 

Geometries 



A list of co-ordinates that are connected by 
straight lines or splines, thereby forming simple 
shapes. They can be coloured. Specialised 
geometries can be used to define chords, boxes 
etc. 

The apparatus required for implementing the 
invention is shown in Fig. 1. It comprises a display 
device 7, normally a VDU screen, on which the 
graphic displays created are to be displayed. Con- 
nected to the display screen 7 are a keyboard 5 
and a pointing device 6, normally a mouse. A 
graphics processor 8 creates the graphic display 
on the screen in accordance with the invention. It 
defines the graphics presentation space in which 
the display is to be created and uses the device 
contexts associated with the display device 7 to 
produce the display. The graphics processor 8 is 
connected to another processor 10 on which the 
application program using the graphic display is 
running and to memory 9. The memory 9 can 
comprise both permanent storage, such as a direct 
access storage device (DASD), and/or temporary 
storage means, such as random access memory 
(RAM). The memory 9 can be divided into smaller 
logical portions, each of which can store all or part 
of a graphics display together with any other in- 
formation necessary for the creation of the display, 
such as the device contexts. Those skilled in the 
art will be able to design the memory so that it is 
suitable for the tasks that have to be undertaken. 
For example, sufficient RAM needs to be provided 
to store graphics displays or parts thereof required 
quickly by the graphics processor 8, whilst enough 
permanent storage needs to be provided so that 
graphics displays or parts thereof can be stored for 
use at a later date. 

The location of the graphics process 8, proces- 
sor 10 and memory 9 is immaterial for the im- 
plementation of this invention. For example, in one 
embodiment the graphics processor is incorporated 
into a workstation together with the display device 
7, keyboard 5 and pointing device 6, whilst the 
processor 10 running the applications program is 
incorporated into a host computer. The memory 9 
is divided between host and workstation. 

In another embodiment, no distinction is made 
between the processor 10 running the applications 
program and the graphics processor 8. The single 
processor carrying out both functions is incorpo- 
rated into a workstation. 
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The overall graphical display of data in an 
application running on the processor 10 can be 
regarded as taking place in different layers as 
shown in Fig. 2. These layers may be regarded as 
s being part of the interface between the processor 
(10) running the application and the user. Four 
layers are shown on this figure. Each layer uses 
the services provided by the next lower layer. 

The highest layer (layer 4) manages views on 

10 the display device 7 by means of windows 12 
using the layout information 14 on graphic objects 
found in a third layer 3. The third layer 3 manages 
the layout of graphic objects in a defined area 
using the graphic object display information and 

75 parameters of a second layer 2. In the second 
layer 2, the composition of more or less complex 
graphic objects 16 are built up using the graphic 
display primitives, also calied fragments, 18 of a 
first layer 1 . The first layer 1 is the lowest level and 

20 manages the display of graphic display primitives 
18 independent of the actual display device 7 
used. It provides an inventory of display primitives 
used in building more complicated figures. The 
IBM Presentation Manager is one example of a 

25 product implementing the first layer 1 . It would be 
installed in the graphics processor 8. 

The current application is concerned with the 
implementation of the second layer 2 of the graphi- 
cal layer concept described in the previous para- 

30 graph. Its principles, however, are not limited to 
this application and may be more widely applied 
by those skilled in the art. 

The method in which the graphic objects 16 in 
the second layer 2 are produced will now be de- 

35 scribed. Before an application can make use of any 
of the graphic objects, the appearance of the 
graphic objects has to be created. This process is 
termed the "registration" of the graphic object and 
involves the creation of a template for the graphic 

40 object which contains details of the information 
required to produce the graphic object. The tem- 
plate is stored in one of the divisons of the mem- 
ory 9 and is assigned a handle, which points to its 
location in the memory 9. 

45 As mentioned above, in order to register the 

graphic object, the user creates the template for 
the graphic object. This is done by defining a 
figure that makes up the graphic object. The figure 
is constructed from combinations of the fragments 

so or drawing primitives supplied by the first level 1 
implementation. The fragments could be, for exam- 
ple, simple geometrical figures such as lines, 
squares or circles, or they could be geometries, 
bitmaps, metafiles or tags. Other types of frag- 

55 ments are possible. An example of a figure 36 
created from a number of fragments 20-34 is 
shown in Fig. 3. 
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With each created figure 36 a symbol 50 is 
also created. This symbol is a much simpler repre- 
sentation of the figure and is stored together with 
the figure as the template for the graphical object 
in the memory 9. The symbol. can be either one of s 
a number of standard symbols supplied in the level 
1 implementation or it could be similarly created 
from fragments. 

Having registered the graphic object by creat- 
ing its template, it is necessary to create an 10 
"instance" of the object. This is required since a 
user running an applications program cannot ma- 
nipulate the graphic object directly, but can only 
operate on an instance of it. For example, the 
applications program may use the same graphic ;5 
object twice but in different contexts. So the ap- 
plications program would require two different in- 
stances of the same graphic object. The instance is 
also stored in memory 9 and is pointed to by an 
instance handle. Using this handle, the graphics 20 
processor 8 can call up the instance of the graphic 
object when required. 

The figures can be more complicated than the 
simple case described above. Figures can be com- 
posed of other figures - termed respectively parent 25 
figures and child figures. So, for example, in Fig. 3, 
the fragments 20 and 21 that make up the 
eyebrows of the face could be defined as a sepa- 
rate child figure, similarly fragments 28 and 29 
making up the mouth could be another child figure. 30 
Separate templates would be constructed for the 
graphic object represented by the two child figures. 
These templates are also stored in memory 9. The 
instance for the figure 36 would thus comprise not 
"only references to the template of the graphic 35 
object making up the parent figure but also to the 
instance handles of the two child figures. The child 
figures would thus be linked to the parent figures. 
The template of the graphic object making up the 
parent figure would contain references to the frag- 40 
ments 22, 24, 26, 30, 32 and 34 but not to frag- 
ments 28 and 29 or 21 and 22. 

Of course the child figures might be more 
complicated than this and, rather than displaying 
the individual fragments from which the child figure 45 
is constructed, the symbol representing the child 
figure could be displayed together with the frag- 
ments making up the parent figure. Whether the 
symbol or the individual fragments which make up 
the child figure are to be displayed is discussed so 
later. 

The data structure of the template for the 
graphic object in the memory 9 is shown on the left 
hand side of Fig. 4A. It consists of a pointer to the 
fragment list in which the individual fragments mak- 55 
ing up the figure are contained and a variable 
which points to the symbol which represents the 
figure. The fragment list is shown on the right hand 



side of Fig. 4A. Each entry in the list is pointed to 
by the handle of the fragment. The handle iden- 
tifies the required fragment in the first layer 1 of 
the graphical display. The next variable in the entry 
indicates the manner in which the fragment is to be 
initially displayed, for example switched on or off. 
How to switch the fragment on or off will be dis- 
cussed below when the concept of a mark style is 
introduced. The relative position indicates the co- 
ordinates of the fragment in the figure. Finally the 
last variable in the entry is the handle to indicate 
the position of the next entry of the fragment list in , 
the memory 9. The pointer in the last entry of the 
fragment list is a special pointer which indicates 
the end of the list. Fragments can be added or 
deleted to the graphic object merely by selecting 
them and adding a new entry into the fragment list. 
The variable indicating the symbol associated with 
the graphic object calls a routine which replaces 
the figure with the symbol. The symbol is, in the 
preferred embodiment, one of a number of stan- 
dard symbols provided in the first layer 1 of the 
graphical display. The symbol could, however, be 
itself built up from fragments, albeit from a fewer 
number of them than in the figure. 

The data structure of an instance of the graphic 
object is shown in Fig. 4B. It consists of a handle 
to the template of the graphic object defined in Fig. 
4A and a list of the handles of the connection 
styles which can be associated with the instance of 
the graphic object. The term "connection style" is 
explained in more detail below. In addition with 
each instance, child objects can be associated. The 
handles of these associated child objects are given 
in a list which is also included in the data structure. 
The data structure of the instance will also contain 
information regarding the display of the individual 
fragments should these be altered from their initial 
values given in the template of the graphic object 
from which the instance is created. 

The child objects are only associated with their 
parent objects. They have no "existence" of their 
own. That is to say the child objects can only be 
displayed on the display device 7 when the parent 
object is also displayed (the reverse is, however, 
not true, a parent object can be displayed without 
its child object). If an instance of the parent object' 
is destroyed, then the instances of the child object 
are also destroyed. Note however, that destroying 
the instance of the parent figure will destroy only 
the instance of the child figure, the template of the 
child object will not be destroyed. A child object 
may, in turn, have further "grandchild" objects as- 
sociated with it, and these in turn can have "great- 
grandchild" objects and so on. Destruction of the 
instances in higher levels of object figures in the 
hierarchy destroys all the instances of the graphic 
object in lower levels of the hierarchy which are 
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dependent on the destroyed higher level instance. 

In addition to creating the instances of the 
graphic objects, it is necessary to define areas in 
which the instances of the graphic objects are to 
be placed. The data structure for the template of 
an area called an area handle is shown in Fig. 5. It 
consists of a list of instances of graphic objects 
that are associated with the area, the relative posi- 
tions of the instances of the graphic objects in the 
area, user data and layout data which is input by 
the application program and a variable indicating 
the si2e of the area. Every registered graphic ob- 
ject has to be associated with at least one area in 
order to be displayed. 

Between two figures in the same area, a con- 
nection can be established. This connection can be 
either automatically visible when both figures are 
displayed, or can be switched on using a pointing 
device, such as a mouse 6. The data structure for 
a template for a connection, called a connection 
style, is shown in Fig. 6A. It comprises the handle 
for the area in which the connection style is used, 
variables to indicate the connection type <e.g. 
straight, curved, dog-legged, etc.), the connection 
line colour (e.g. red. blue, green, etc.) and the 
connection line type (e.g. points, continuous line, 
etc.). These options are chosen from the options 
available in the first layer 1 implementation. 

The connection style is used by creating an 
instance of it in a similar manner to the creation of 
an instance of a graphic object. The data structure 
of the instance of the connection style is shown in 
Fig. 6B. It comprises the handle to the template of 
the connection style, a list of the handles of the 
instances of the graphic objects to be connected 
and a tag which may be attached to the connection 
to label it. 

Two different types of marks can be defined. 
The first type of mark allows a user to mark a 
figure with a specific pattern and colour. The mark 
is laid over the figure or displayed as a background 
to the figure. An example of this is shown in Fig. 7 
in which a mark comprising a box with diagonal 
lines is laid over one of the displayed figures. The 
second type of mark allows one to declare one or 
more of the fragments making up the figure to be 
mark fragments. These fragments can then be ei- 
ther displayed or suppressed, thereby allowing the 
mark to be visible. The data structure for the tem- 
plate of the mark, called a mark style, is shown in 
Fig. 8. The handle of the area indicates in which 
area the mark style is to be displayed. The mark 
type indicates whether the mark style is of the 
overlay, background or fragment type. In the first 
instance, the template will also contain details of 
the pattern of the mark style and its colour. In the 
second instance, the template will contain a list of 
the handles of the mark fragments. Those parts of 
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the template not required (i.e. the handles of the 
mark fragments or the colour and pattern of the 
mark style) are given null values. 

In order to display the graphic objects, their 
5 positions with respect to each other have to be 
defined. This is done using a 'view'. A view can be 
assigned to both areas and graphic objects. The 
area or graphic object is called the parent of the 
view. The view is defined as a part of its parent 
10 and has a size and position relative to its parent. 
The size of the view is less than or equal to the 
size of its parent. For an area, for example, the 
view would detail the relative positions of all the 
figures contained in this part of an area. For in- 
15 dividual parent figures with child figures, the view 
would define the relative positions of the child 
figures with each other and with respect to the 
parent figure when they are to be displayed to- 
gether on the display device 7. The data structure 
20 for the template of a view is shown in Fig. 9. It 
consists of the handle of the area or instance of the 
graphic object with which the view is associated, 
the relative positions of the graphic objects within 
an area or child objects within a parent object. 
25 handles to the display windows and the size and 
position of the view. Details of the windows with 
which instance of the view can be associated are 
given below. 

Fig. 10 shows a display device 50 on which 
30 some of these features are illustrated. The area 52 
comprises three figures, figure A 54, figure B 56 
and figure C 58 which are each labelled. Figure 10 
also shows a further figure, labelled 71 , and called 
figure D, which is repeated six times within the 
35 area. Figure A 54 is built up from two fragments 60 
combined together, the fragment having the handle 
'processor side'. Figure B 56 is built up from 
fragments 62, 64 and 66 which have the handles 
'printer', 'graphics' and 'type' respectively. The fig- 
40 ure C is built up from the fragment 62 (also present 
in figure B) and the fragment 70. 

Figure D 71 is built up from the single frag- 
ment 72, labelled 'connector*, an example of which 
is shown on the display screen 50 outside the area 
4$ 52. The figure D 71 clearly shows the difference 
between a graphic object as incorporated in an 
area and a fragment. The fragment is supplied by 
the first level 1 of the graphical display. It cannot, 
however, be addressed directly until a graphic ob- 
50 ject has been registered and an instance of the 
graphic object created. 

Figure 10 also shows two examples of in- 
stances of connection styles. Connection style 71 
shows a dog-legged continous line between figure 
55 A 54 and one instance of figure D 71. Connection 
style 76 shows a dotted straight line between figure 
A 54 and another instance of figure D 71 . 
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The procedures used for creating the code to 
define the figures, areas, marks and views depend 
on the type of implementation used for providing 
the fragments and on the type of display device 7, 
pointing device and graphics processor 8 supplied. 
They can be developed using standard compilers 
and available tools. 

Let us now consider the display of the graphic 
objects on the display device 7. Clearly, as the 
number of figures displayed changes, then the 
appearance of a figure on the display screen 7 will 
have to change. For example displaying a very 
large number of figures will lead to a complex 
structure and the 'overview' of the structure may 
be lost. Problems may also occur when one wishes 
to operate only on one particular figure, but the 
display device 7 shows a multitude of figures. This 
invention therefore provides two types of display 
techniques: symbol display and fragment display. 
In the symbol display, the figure is displayed using 
the symbol defined in the template for the graphic 
object. When, however, fragment display is speci- 
fied, then all of the fragments making up the figure 
are shown. The user can switch between symbol 
and fragment display, or the graphics processor 8 
can automatically select the most appropriate type 
for display on the display screen 7. 

In order to achieve this function, it is necessary 
to define two types of windows: an overview win- 
dow and a detail window. Both types of windows 
are correlated with a view (see above). In an over- 
view window at all times, all of the child figures of a 
parent figure or all of the figures in an area are 
displayed in symbol form. That is to say the frag- 
ments making up the figure are not displayed, only 
the symbol associated with the figure is displayed. 
On the other hand, in a detail window the figures in 
a view are displayed in either symbol or fragment 
form. The user can select which of the figures she 
or he wishes to observe by creating a new view. 
This view is shown on the display device 130 as an 
outline. An example of this is shown in Fig. 11. On 
the display device 130, an overview window 100 
and a detail window 120 are shown. The figures in 
the overview window are shown only in symbol 
form. Part of the figures are outlined 1 10 and these 
make up a view. The figures in the view are dis- 
played in fragment form in the detail window 120. 
The windows containing the views can be moved 
around the display screen 130 by commands en- 
tered on the keyboard 5 or by using the pointing 
device 6. 

In the simplest display form, all of the child 
figures of a parent figure or all of the figures in an 
area are displayed in symbol form in the overview 
window 100 and, within the detail window 120, the 
figures of the view with which the window 120 is 
correlated. The user is free to operate on, alter and 
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add new figures using the routines mentioned 
above. 

In a more complicated display, the child figures 
of a parent figure or all of the figures in an area are 

5 similarly displayed in the overview window 100. 
However, no child figures of child figures are dis- 
played in the overview window. A view is then 
defined by outlining part of the overview window 
100 as shown in Fig. 11. The marking is done 

io using a pointing device 6 or by instructions from a 
keyboard 5. In the detail window 120, all figures 
and, if appropriate, the associated child figures 121 
contained in the marked outline 110 are displayed. 
As described above, the invention will select be- 

75 tween fragment display and symbol display in the 
detail window 120 as required. The graphics pro- 
cessor 8 uses a threshold value to determine which 
type of display to use. This threshold value is 
changeable by the user. In the preferred embodi- 

20 ment, the automatic selection is carried out by 
instructing the graphics processor 8 to chose sym- 
bol display whenever the number of displayed in- 
stance of the graphic objects exceed a t certain 
number. 

25 In order to view another part of the structure, 

the user may change the size and position of the 
marked outline 110 using a pointing device, such 
as the mouse 6, or the keyboard 5. The effect of 
this is to change the size and position of the view 

30 which is then stored in the memory 9. The 
changed view will be displayed within the detail 
window 120 as defined above. 

Zooming is also possible within the detail win- 
dow 120. One changes the view by selecting those 

35 figures within the detail window 120 which it is 
desired to observe in greater detail. These selected 
figures are then presented in the detail window 
120. Within the overview window 100, the marked 
outline 110 is changed to illustrate that portion of 

40 the overview contained within the new detail win- 
dow 120. Changing the size and position of the 
overview window 100 or zooming and scrolling in 
the detail window 120 operates on the same in- 
stances of the graphic objects, thus changes in 

45 either of the windows will lead to corresponding 
changes in the other window being automatically 
displayed. 

As mentioned previously, some child figures 
may themselves have child figures (i.e. grandchild 

so figures) attached to them. These may be seen in 
the detail window 120 but never in the overview 
window 100. Whether the grandchild figures are 
observed can be determined by changing a thresh- 
old value in the graphics processor 8. In a similar 

55 manner to the selection of the symbol display or 
the fragment display, the invention decides whether 
a display in the detail window 120 would become 
too complicated if grandchild figures were being 

7 
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displayed and then switches off the display of 
grandchild figures. 

Claims 

5 

1. Graphics display tool with graphics processor 

(8) for creating graphic objects, image memory 

(9) for storing the graphic objects display 
means (7) for displaying the graphic objects 

and a graphics processor (8) comprising 10 
means for producing windows <100, 120) on 
said display means (7; 130) characterised in 
that 

the graphics processor (8) further comprises 75 

means for displaying within a first window 
(100) a plurality of said graphic objects; 

means (110) for selecting a subset of said 20 
plurality of said graphic objects; and 

means for displaying within a at least second 
window (120) said subset of said plurality of 
said graphic objects. 25 

2. Graphics display tool according to claim 1 
further characterised in that 

said graphic object can be displayed in either 30 
symbol form, as a single symbol, or fragment 
form, as a collection of discrete fragments, 

whereby said graphic object is always dis- 
played in symbol form in said first window 35 
(100) and 

may be displayed in symbol form or in frag- 
ment form in said second window (120). 

40 

3. Graphics display tool according to claim 1 or 2 
further characterised in that the graphics pro- 
cessor (8) comprises 

means for selecting a further subset from the 45 
said subset of said plurality of graphic objects; 

and means for displaying said further subset in 
a third window. 

50 

4. Graphics display tool according to one of 
claims 1-3 further characterised in that 

said graphic objects may have child graphic 
objects which may be displayed in said sec- 55 
ond (120) or said third window. 



5. Graphics display tool according to one of 
claims 1-4 further characterised in that 

said graphic object is displayed in said symbol 
form when the complexity of the display of 
said graphic objects in said second (120) or 
said third windows exceeds a user-defined 
threshold value. 

6. Graphics display tool according to one of 
claims 4 or 5 further characterised in that 

said child graphic object is displayed in when 
the complexity of the display of said graphic 
objects in said second (120) or said third win- 
dows does not exceed a user-defined thresh- 
old value. 

7. Graphics display tool with graphics processor 

(8) for creating graphic objects, image memory 

(9) for storing the graphic objects and display 
means (7) for displaying the graphic objects 
characterised in that 

the graphic objects stored in said image mem- 
ory (9) can be linked together. 

8. Graphics display tool according to claim 7 
further characterised in that 

said linked graphic objects form a hierarchy 
and that 

graphic objects lower in the hierarchy can only 
be displayed during or after display of graphic 
objects higher in the hierarchy. 

9. Graphics display tool according to claim 7 
further characterised in that 

said linked graphic objects form a network of 
the same hierarchical level; and 

all graphic objects in the same hierarchical 
level can be simultaneously displayed. 

10. Graphics display tool according to one of 
claims 7-9 characterised in that 

linkages (74, 76) between said graphical ob- 
jects can be displayed on said display means 
(7). 

11. Graphics display tool according to one of 
claims 7-10 characterised in that 

said graphics object comprises a figure (3;, 54, 
56, 58) built up of fragments (18; 20, 21, 22, 
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24, 26, 28, 29, 30, 32, 34; 60, 62, 64, 66, 70, 
72) supplied by an inventory. 

12. Graphics display tool according to one of 
claims 7-1 1 characterised in that s 

said graphics object comprises a symbol (50). 

13. Graphics display tool with graphics processor 

(8) for creating graphic objects, image memory io 

(9) for storing the graphic objects and display 
means (7) for displaying the graphic objects 
characterised in that 

the graphic objects stored in said image mem- 75 
ory (9) comprise both a figure (3; 54, 56, 58) 
and a symbol (50). 

14. Graphics display tool according to claim 13 
wherein said figure (3; 54, 56, 58) is built up 20 
from a number of fragments (18; 20, 21, 22, 

24, 26, 28, 29. 30, 32, 34; 60, 62, 64, 66, 70, 
72). 

15. Graphics display tool according to one of 25 
claims 13 or 14 further characterised in that 

the symbol (50) is displayed on the display 
means (7) instead of the figure (3; 54, 56, 58) 
when the complexity of the display exceeds a 
user-defined threshold. 30 

16. Method for creating and displaying graphic ob- 
jects on display means (7) comprising 

creating the figure (3; 54, 56, 58) representing 35 
said graphic object from a plurality of frag- 
ments (18; 20, 21, 22, 24, 26, 28, 29, 30, 32, 
34; 60, 62, 64, 66, 70, 72) supplied by an 
inventory of fragments, 

40 

characterised in that it further comprises 

associating with each said graphic object a 
symbol (50); 

45 

defining an area comprising a plurality of 
graphic objects; 

defining links between graphic objects in said 
area; 50 

associating a window (100, 120) with each 
area; and 

producing said window on said display means 55 
(7). 



17. Method according to claim 16 further charac- 
terised in that 

a subset (110) of graphic objects in said area 
can be selected and a window produced to 
display only said subset of graphic objects. 

18. Method according to claim 16 or 17 further 
characterised that 

said graphical objects are displayed either in 
fragment form or symbol form, depending on 
whether the complexity of the display has 
reached a user-defined defined threshold val- 
ue. 

19. Method according to any of claims 16-18 fur- 
ther characterised in that 

said links between graphical objects can be of 
a hierarchical nature or can be between graphi- 
cal objects of the same hierarchical level. 

20. Method according to claim 19 further charac- 
terised in that 

graphical objects in a lower hierarchical level 
are only displayed when the complexity of the 
display does not exceed a user-defined thresh- 
old level. 

21. Method according to one of claims 16-20 fur- 
ther characterised in that one 

said graphic object is created by first register- 
ing a template for the graphic object which 
comprises the information relating to the frag- 
ments (18; 20, 21, 22, 24, 26, 28, 29, 30, 32, 
34; 60, 62, 64, 66, 70, 72) from which the 
figure (3; 54, 56, 58) is built and the symbol 
(50) 

and then creating an instance of said graphic 
object, wherein operations on said graphic ob- 
ject are carried out on the instance of said 
graphic object. 

22. Use of graphics display tool according to any 
of claims 1-12 to create an interface between 
an applications program running on a proces- 
sor (1 0) and a user. 



9 



J 0529121A1Jj> 



EP 0 529 121 A1 




EP 0 529 121 A1 



Application UJindouj Control 
Lnyen 

i z r 



<C=^> 




■■: Hguse'Eyenti 




Application 

Object 
Structure 



Graph Object 
Structure 



Graph Object 
Data 



Fragment 
Definition 
(Meta File, 
BitMap File, 
Font File etc.) 




FIG. 3 



> 



11 



EP 0 529 121 A1 



FIGURE TEMPLATE 



FRAGMENT LIST 



SYMBOL 



END 



FIG. 4A 



FRAGMENT 1 



INITIAL DISPLAY 1 



RELATIVE POSITION 1 



HANDLE OF FRAGMENT 2 





FRAGMENT 2 






INITIAL DISPLAY 2 






RELATIVE POSITION 2 






HANDLE OF FRAGMENT 3 







FRAGMENT n 



INITIAL DISPLAY n 



RELATIVE POSITION n 



POINTER 



3 0529121A1 I > 



12 



EP 0 529 121 A1 



INSTANCE 



OBJECT TEMPLATE HANDLE 



LIST OF CONNECTION STYLES 



LIST OF CHILD OBJECTS 



FIG- 



AREA 



LIST OF INSTANCES 



RELATIVE POSITION 



USER DATA 



LAYOUT DATA 



SIZE OF. AREA 



LIST OF VIEWS 



FIG. 



3NSDOCID; <EP 0529121Al_l_> 



13 



EP 0 529 121 A1 



CONNECTION STYLE 



HANDLE OF AREA 



INITIAL DISPLAY 



CONNECTION TYPE 



CONNECTION LINE COLOUR 



CONNECTION LINE TYPE 



FIG. 6A 



INSTANCE OF CONNECTION STYLE 



CONNECTION STYLE HANDLE 



LIST OF GRAPHIC OBJECTS 



TAG 



FIG, 6B 



MARK STYLE 



HANDLE OF AREA 



MARK TYPE 



COLOUR OF MARK 



PATTERN OF MARK 



HANDLE OF FRAGMENT 



FIG. 8 



BNSDOCID: <EP 0529121A1_L> 



14 



EP 0 529 121 A1 




VIEW 



HANDLE OF PARENT 



LIST OF INSTANCES 



RELATIVE POSITION 



SIZE 



POSITION 



LIST OF WINDOW HANDLES 



FIG. 9 



NSDOCID: <EP 0529121 A 1J_> 



15 



EP 0 529 121 A1 



52 



50 



AREA 



71. 



FIGURE A 


iiri nr 





-54 



I 

i FIGURE B 




,60 



FRAGMENTS 
OF FIGUREA 



FRAGMENTS 
OF FIGURE B 



PROCESSOR SIDE 
62 
I 



1 



C3 



66 



PRINTER 



GRAPHICS TYPE 



FRAGMENTS 
OF FIGURE C 



FRAGMENTS 
OF FIGURED 




70 





ABC 




DEF 




GUI 



PRINTER 

72 
/ 

S3 

CONNECTOR 



LINE 



FIG. 10 




BNSDOCID: <EP 0529121A1_I_> 



16 



J) 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 



EP 91 11 4247 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION Out. CL5 ) 



EP-A-0 241 071 ( OCE-NEDERLAND B. V. ) 14 October 
1987 

* abstract; figure 3 * 

* column 4, line 16 - line 20 * 



COMPUTER. 

vol. 18, no. 8. August 1985, LONG BEACH US 
pages 27 - 35; 

BROWN, CARLING.HEROT, KRAMLICH, SOUZA: 'Program 
Visualization: Graphical Support for Software 
Development* 

* page 28, right column, last paragraph - page 
29, left column, line 10; figures 1,2 * 

* page 29, left column, line 25 - line 37 * 

* page 30, left column, line 11 - middle column, 
line 5 * 



7.8,11 



1,4,13, 

14,16, 

19,22 

1,4, 
7-10,22 



G06F3/Q33 



TECHNICAL. FIELDS 
SEARCHED (Int. CI. 5 ) 



G06F 



The present search report has been drawn op for all claims 



Plac* mt lamxk 


TMm mf CHpUlu «f U» Matt 




THE HAGUE 


23 APRIL 1992 


LA GIQIA C. 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant If taken aloe* 

Y : particularly relevant H combined with another 

document of th« same category 
A : technological background 
O : noo-wrttten disdesure 
P : Intermediate document 



T : theory or principle underlying the Invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document died in the application 
L ; document dt«d for other reasons 



* : member of the same patent family, corresponding 
document 



3NSDOCID; <EP 0529121 A 1J_> 



THIS PAGE BLANK <usno) 



